# 1-bit quantized LLM

BitNet b1.58 3B is a 1-bit quantized large language model trained on 100 billion tokens from the RedPajama dataset, significantly reducing computational resource requirements while maintaining performance.